A maximum entropy principle explains quasi-stationary states in systems with 
long-range interactions: the example of the Hamiltonian Mean Field model 
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A generic feature of systems with long-range interactions is the presence of quasi-stationary states 
with non-Gaussian single particle velocity distributions. For the case of the Hamiltonian Mean Field 
(HMF) model, we demonstrate that a maximum entropy principle applied to the associated Vlasov 
equation explains known features of such states for a wide range of initial conditions. We are able 
to reproduce velocity distribution functions with an analytical expression which is derived from the 
theory with no adjustable parameters. A normal diffusion of angles is detected and a new dynamical 
effect, two oscillating clusters surrounded by a halo, is also found and theoretically justified. 
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PACS numbers: 
ical systems. 



05.20.-y Classical statistical mechanics; 05. 45. -a Nonlinear dynamics and nonlinear dynam- 



Long-range interactions are common in nature Q . Ex- 
amples include: self gravitating systems 0], plasmas 3, 
dipolar magnets 0] and wave-particle interactions 3- 
Theoretical studies have shown that the thermodynamic 
properties of these systems differ from those of systems 
with short-range interactions. For instance, long-range 
interactions may produce a negative microcanonical spe- 
cific heat [|| and, more generally, inequivalence of the 
canonical and microcanonical ensembles • Also the dy- 
namics of models with long-range interactions has been 
studied, revealing a variety of peculiar features such as 
the presence of breaking of ergodicity in microcanoni- 
cal dynamics 0, and the existence of quasi-stationary 
states whose relaxation time to equilibrium diverges with 
system size 0, ^| . A number of paradigmatic toy mod- 
els have been proposed that provide the ideal ground for 
theoretical investigations. Among others, the Hamilto- 
nian Mean Field (HMF) model [lfj is nowadays widely 
analyzed because it displays many features of long range 
interactions, while being simple to study analytically and 
numerically. Within the HMF scenario, non-Gaussian 
velocity distributions |l2j and signatures of anomalous 
diffusion have been reported in the literature. These 
discoveries have originated an intense debate about the 
general validity of Boltzmann-Gibbs statistical mechan- 
ics for systems with long-range interactions 01 . Non- 
Gaussian distributions have been fitted using Tsallis' q— 
exponentials |l5j . i.e. algebraically decaying profiles pre- 
dicted within the realm of nonextensive statistical me- 
chanics. Based on these findings, the generalized thcrmo- 
statistic formulation pioneered by Tsallis was proposed 
as a tool to describe the properties of quasi-stationary 
states 0. 

In this Letter, we demonstrate that a maximum en- 



tropy principle inspired by Lyndcn-BclPs theory of "vi- 
olent relaxation" for the Vlasov equation allows to ex- 
plain satisfactorily the numerical simulations performed 
for the HMF model. Analytically obtained PDF's are 
superimposed to the numerics without adjusting any free 
parameter. In other words, our results point to the 
fact that there is no need to invoke generalized forms 
of Boltzmann-Gibbs statistical mechanics to describe the 
non-equilibrium properties of this system. 

The HMF model describes the motion of N coupled 
rotators and is characterized by the following Hamilto- 
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where 6j represents the orientation of the j-th rotor 
and pj is its conjugate momentum. To monitor the 
evolution of the system, it is customary to introduce 
the magnetization, a global order parameter defined as 
M = |M| = \^2,m.i\/N, where mj = (cos6>,,sin6>j) is 
the local magnetization vector. Starting from out-of- 
equilibrium initial conditions, the system gets trapped in 
Quasi-Stationary States (QSS), whose lifetime diverges 
when increasing the number of particles N. Importantly, 
when performing the mean- field limit (N — > oo) before 
the infinite time limit, the system cannot relax towards 
Boltzmann-Gibbs equilibrium and remains permanently 
confined in QSS. In this regime, the magnetization is 
lower than the one predicted by the Boltzmann-Gibbs 
equilibrium and the system apparently displays a number 
of intrig uing anomalies, e.g. non Gaussian velocity distri- 
butions UM and non standard diffusion in ang le hj. We 
shall here provide a strong evidence that the above phe- 
nomena can be successfully interpreted in the framework 
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of the statistical theory of the Vlasov equation, a general 
approach originally introduced in the astrophysical and 
2D Euler turbulence contexts [15 [TR Hj| . 

First, let us recall that for mean-field Hamiltonians 
such as 0, it has been rigorously proven that, in 
the N — ► oo limit, the TV-particle dynamics is described 
by the Vlasov equation 
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where f{9 1 p,t) is the microscopic one-particle distribu- 
tion function and 
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f (6, p,t) cos 6d9dp , (4) 
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f(9,p,t) sm6d6dp 
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The specific energy h[f] = J f(p 2 /2)f(9,p,t)d6dp- 
(Ml + M%-l)/2 and momentum P[f] = 
J Jpf{@iPi t)d9dp functionals are conserved quanti- 
ties. 

We now turn to illustrate the maximum entropy 
method. The basic idea is to coarse-grain the micro- 
scopic one-particle distribution function f(6,p,t) into a 
given set of values. It is then possible to associate an en- 
tropy to the coarse-grained distribution /, i.e. averaged 
over a box of finite size, and statistical equilibrium can be 
determined by maximizing this entropy while imposing 
the conservation of certain Vlasov dynamical invariants. 
A p hysical description of this procedure can be found in 
|l7ll2(l | and a rigorous mathematical justification is given 
in Ref. [H|. 

In the following, we shall assume that the initial sin- 
gle particle distribution takes only two distinct values, 
namely /q = l/(4AgA p ), if the angles (velocities) lie 
within an interval centered around zero and of half-width 
Ag (A p ), and is zero otherwise. This choice corresponds 
to the so-called "water-bag" distribution which is fully 
specified by energy h[f] = e, momentum P[f] = ct and 
initial magnetization Mo = (M x o, M y o). Vlasov time 
evolution can modify the shape of the boundary of the 
"water-bag", while conserving the area inside it. Hence, 
the distribution remains two-level (0, fo) as time pro- 
gresses. Coarse-graining amounts to performing a local 
average of / inside a given box and this procedure results 
in /. In this two- level situation, the mixing entropy per 
particle associated with / reads 
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The shape of this entropy derives from a simple combina- 
torial analvsis|l7l l20j. The maximum entropy principle 



is then defined by the following constrained variational 
problem 



5(e, cr) = max 



s(f) 



h(f) = e;P(f) = a;Jd9dpf=l 



•(7) 



The problem is solved by introducing three Lagrange 
multipliers /3//o, A//o and /V/o for energy, momentum 
and normalization. This leads to the following analytical 
form of the distribution 



f{o,p) = h 



e -/3(p 2 /2-M y [/]sine-Af x [/] cos6)-\p-^ 
1 _|_ e -/3( p 2/2-M y [f]sme-Mx[f}cose)-\p-fi ' 



(8) 

This distribution differs from the Boltzmann-Gibbs 
one because of the "fcrmionic" denominator which is orig- 
inated by the form I© of the entropy. Inserting expres- 
sion ||SJ into the energy, momentum and normalization 
constraints and using the definition of magnetization, 
it can be straightforwardly shown that the momentum 
multiplier A vanishes. Moreover, defining x — and 
m = (cos 9, sin 9), yields the following system of implicit 
equations in the unknowns (3, x, M x and M y 
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,0M-m) = M 



with F (y) = J exp(— v 2 /2)/(l + yexp(— v 2 /2))dv, 
F 2 (y) = J v 2 exp(— v 2 /2)/(l + y exp(— v 2 /2))dv, where 
v = s/]3p. This system of equations is then solved using a 
Newton-Raphson method and the integrals involved are 
also performed numerically. For e = Umjy^oo H/N = 
0.69, a value often considered in the literature |2J|, the 
maximum entropy state has zero magnetization, for any 
initial magnetization Mq = |Mo| < M cr n = 0.897. 
Hence, the QSS distribution does not depend on the an- 
gles and the velocity distribution can be simplified into 



-f3p 2 /2-ti, 



fQSsip) = ./b — 



(10) 



with (3 and [i numerically determined from system 0. 
Velocity profiles predicted by (jTU|) are displayed in Fig.^t 
for different values of the initial magnetization. Gaus- 
sian tails are always present, contrary to the power-law 
(^-exponential) fits reported in Ref. [12|. Note that the 
power-law decay was already excluded on the basis of 
numerical simulations in Ref. \22\ for initial zero magne- 
tization states. At Mo = M cr u = 0.897, a bifurcation 
occurs (see Fig. Q]d) and the magnetization of the quasi- 
stationary state Mqss becomes non zero, which means 



FIG. 1: a) Velocity profiles (1101 predicted theoretically for 
different initial magnetizations (see legend, where we have 
reported also the values of the parameter j3 and /j,). b) final 
magnetization as a function of Mo. A phase transition is 
observed at M = 0.897 for e = 0.69. 

that the equilibrium Lyndcn-Bell distribution develops 
an inhomogeneity in angles. The details of this phase 
transition are further discussed in Ref. [23j| . 

We validate our theoretical findings in the initial mag- 
netization range Mq G [0, ilf cr jt], by performing numeri- 
cal simulations with N ranging from 10 3 to 10 7 . Numer- 
ical velocity distributions are compared in Fig. |2 with 
the analytical solution 1|1U|) . Although not a single free 
parameter is used, we find an excellent agreement in the 
tails of the distribution. The discrepancies observed in 
the center of the distributions are commented below. 

To discuss the behavior of M in the QSS, one must 
distinguish different magnetization intervals. Consider 
first the interval M G [M a ,M crit ], with M a « 0.5. Both 
M x and M y are found to approach zero when the num- 
ber of rotators is increased, in agreement with the the- 
ory outlined above. Our results correlate well with the 
scaling \M\ oc V~ 1/6 reported in Ref. |24|. Numerical 
simulations also confirm the presence of a bifurcation at 
Mq = M cr it, and indicate that the distribution in angles 
is indeed inhomogeneous above this value. Interestingly, 
when the initial magnetization lies instead in the inter- 
val [0, M a ], M x and M y display regular oscillations in 
time, which appear only when a large enough number 
of rotators (N > 10 6 ) is simulated. It is important to 
emphasize that the oscillations are centered around zero, 
i.e. the equilibrium value predicted by our theory. 

We now discuss the presence of two symmetric bumps 
in the velocity distributions obtained numerically (see 
Fig. |2l . This is a consequence of a collective phenomenon 
which leads to the formation of two clusters in the (6,p) 
plane. Both clusters form early in time and then acquire 
constant opposite velocities which are maintained during 
the time evolution, thus enlarging their relative separa- 
tion. Consequently, the bumps displayed by the velocity 
distributions are not transient features, but represent in- 
stead an intrinsic peculiarity of QSS. To the best of our 
knowledge, this is a new collective phenomenon which has 
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FIG. 2: Velocity distribution functions. Symbols refer to 
numerical simulations, while dashed lines stand for the the- 
oretical profile (1101 . Panels a), b) and c) present the three 
cases Mo = 0.3, Mo = 0.5 and Mo = 0.7 in lin-log scale, while 
panel d) shows the case Mo = 0.3 in lin-lin scale. The nu- 
merical curves are computed from one single realization with 
N = 10 7 at time t = 100. Here e = 0.69. 

not been previously detected. A simple dynamical argu- 
ment can be elaborated to shed light onto the process 
of formation of the clusters. Consider the one-particle 

2 

Hamiltonian e(9,p) = ^ — M x cos 9 — M y sin 6 associated 
to JQ), where {0,p) are the conjugate variables of the se- 
lected rotor. For short times, 6 ~ 6o+pot. One then finds 
M x ~ (sinA e sinApi)/(A e A p i) and M y ~ 0. Using this 
result, one ends up with 

e(M = T + S^l [sin {e Apt) + sin {e + Apt)] ' 

(11) 

which corresponds to the Hamiltonian of one particle in- 
teracting with two waves of phase velocities ±A P . De- 
pending on the initial condition, the particles can be 
trapped in one of the two resonances, the latter being 
therefore directly responsible for the arising of two highly 
populated regions. Moreover, by including higher order 
corrections to the above calculation one can show that 
the two resonances tend to overlap when Mo — > 1, in 
agreement with our numerical findings. 

Having derived an analytical expression for the veloc- 
ity distribution function I|1U|I , which is fully validated by 
the numerics, enables to take advantage of the predic- 
tions recently obtained in Ref. j^, where it has been 
demonstrated that momentum autocorrelation functions 
can be deduced by knowing only the tails of the velocity 
distributions. Since these are Gaussian (see Eq. ITUjl h 
one expects algebraic decay of momentum autocorre- 
lation. The mean square displacement of the angles 
a 2 {t) = jj J^i ~ ^i(O)] 2 is also a quantity of inter- 
est. The scaling a 2 cx V defines the diffusive behavior: 
7=1 corresponds to normal diffusion and 7 = 2 to 
free particle ballistic dynamics. Intermediate cases corre- 
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spond to the anomalous diffusion behavior. Here, for all 
water-bag initial conditions, the behavior of the momen- 
tum autocorrelation function implies |25| that a weakly 
anomalous diffusion has to be expected, with a diffusion 
exponent 7=1 and logarithmic corrections. On the nu- 




reccntly found in Ref |27j |. Our maximum entropy prin- 
ciple is unable to capture this phenomenon, for which we 
have developed an analytical approach based on analogies 
with similar effects encountered in plasma- wave Hamilto- 
nian dynamics. More refined maximum entropy schemes, 
accounting for the conservation of additional invariants 
besides the normalization, are expected to give a full de- 
scription of these phenomena and represent a challenge 
for future investigations. 

We acknowledge financial support from the PRIN05- 
MIUR project Dynamics and thermodynamics of systems 
with long-range interactions. 



FIG. 3: The exponent 7 = d log(<j 2 )/d log(t) is plotted as 
a function of the rescaled time r = t/N. Starting from the 
initial ballistic value 2, it converges to the normal diffusion 
exponent 1. Simulations refer to Mo = 0.3, and Mo = 0.9. 
Here N = 10 s and e = 0.69. 

merical simulations side, it is claimed in Ref. |2^j that 
the QSS display anomalous diffusion with an exponent 
7 in the range 1.4 — 1.5 for 0.4 < Mo < 1. These re- 
sults are contradicted by more recent papers [2(|, where 
normal diffusion behavior is found. To provide further 
insight, we have monitored the time evolution of a 1 by 
employing a larger number of particles than in previous 
investigations. As clearly demonstrated by the inspec- 
tion of Fig. |3 a large value of the exponent 7 is clearly 
excluded. On the contrary, the almost normal diffusion 
found is in complete agreement with the theoretical sce- 
nario discussed above. 

In this paper, by drawing analogies with the statistical 
theory of "violent relaxation" in astrophysics and 2D Eu- 
lcr turbulence, we have analytically derived known prop- 
erties of the quasi-stationary states of the HMF model. 
In particular: i) velocity probability distributions in all 
quasi-stationary states investigated are well described by 
Lynden-Bell statistics (|1U|I : ii) Gaussian tails of such 
maximum entropy states ensure an algebraic decay of 
momentum autocorrelation functions and, hence, a nor- 
mal diffusion of the angles. Our theoretical approach is 
fully predictive, contrary to results obtained using nonex- 
tensive thermostatistics |l 5| . which consist in parametric 
fits that are not justified from first principles [l2|. Despite 
this success of "violent relaxation" theory, we do not ex- 
pect it to be so precise in all long-range systems: due to 
incomplete relaxation of the Vlasov equation [ltI Hil l2(i| . 
the QSS should deviate somewhat from Lyndon-Bell's 
statistical prediction. Besides that, we have discovered 
that a double cluster spontaneously forms for all mag- 
netizations. This collective effect was not known before. 
Similar time-dependent quasi-stationary states have been 
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